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ABSTRACT ' 

The purposes of the project were: (1) to determine if 
eg^uality of educational opportunity exists for students in grades K-6 
in the Bhinelander, Wisconsin, school district; and (2) to develop a 
model for elementary school program evaluation^ Learner achievement 
of instructional objectives was accepted as the basic indicator of 
equality of educational opportunity^ The district goals of sb1€ 
concept and basic skills^-the latter restricted to jnath, science,, and 
reading-^- were selected as the 'areas in which learner achievement 
would hB examined. Data describing teachers ' preparation, teacher 
instructional preferences, and amoun't of time spent on the subj^ect 
was coll-ected, and a cost analysis per student by school for 1974-75 
was done simultaneously. This hypothesis was tested: "There will be 
no significant differences with references to learners' perceptions 
of self concepft and to learner, achievement in mathematics, Science, 
and Beading (at specified grade levels) across Ehinelander Elementary 
Schools." The data essentially supprorts the position that equality of 
educational opportunity does exist i^n grades k-6 in Ehinelander 
schools. A model to assist in the evaluation of elementary school 
programs was developed and is appended. Additional values of the 
study included an increased awareness of objectives related to 
instructor goals and, a reexaminatipn of curricular and instructional - 
objectives. In addition, the study developed an increased awareness 
of a need for continual cost analysis and an increased understandix^g, 
of evaluation procedures. (RC) 
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ABSTRACT 

« 

The purposes of the project were: 1) to determine if 
equality of educational opportunity exists for students in 
grades K-6 in the Rhinelander, Wisconsin, school district;, 
and 2) to develop a model for elementary school pro^gram eval- 
uation . a 

6 Learner achievement of instructional objectives was 
accepted as the basic indicator of equality of educational 
opportunity. The district goals (see Appendix A) of self 
concept and basic skills--the latter restricted to math, 
science, and reading — were selected-^s the areas in which 
learner achievement would be examined. Data describing 
teachers' preparati^on , teacher instructional preferences, and 
amount of time spent on the subject v/as collected, and a cost 
analysis per student by school for 1974-75 was done simultan- 
eously- 
Testing was as follows: 







Grades 








2 


4 


6 


Self Concept 


N = 


0 


261 


311 


Mathematics 


N = 


267 


0 


311 


Science 


N = 


2^1 


251 


289 


Reading 


N = 


0 


274 


311 



The hypothesis to be tested is stated: 

"There will be, no significant differences with 
references to learners' perceptions of self 
concept and to learner achievement in mathe- 
matics, science, and reading (at specified 
grade levels), across Rhinelander Elementary 
Schools . " 
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Analysis of covariance was used to test for significant 
differences at the .05 level. Sex, socio-economic status, and 
IQ were covariates . Of 1210 different cells in the project, 
41 were found to be significant- . The data essentially supports 
the position that equality of educational opportunity does ex- 
ist in grades K-6 in Rhinelander schools. 

A model to assist in ' the evaluation of elementary school 
Droqrams v/as developed. See Appendix B. 

Additional values of the study, inclucfed an increased 
awareness of objectives related to instructor goals and -a re- 
examination of curricular and instructional objectives. In 
addition, the study developed an increased awareness of a need 
for continual cost analysis and an increased understanding of 
evaluation procedures. . ' 

It was recommended that the study be replicated for 
1975-76 and expanded to other goals of the system as well as 
additional subject matter areas. It was also recommended that 
more energies be. spent on criteria referenced instruction. The 
final recommendation was that the data be used for investigation 
of quality of instruction, inservice programs, cost control, 
buildinq desiqn, and staff deployment- 



I. IDENTIFYING INFORT^ATION •.. _ . 

A. ELEMENTARY SCHOOL EVALUATION: The primary objec- 
tive of this project was to evaluate one of the 
district's principal goals: to provide all child - 
ren in the K-6 component of the school district 
with equal educational opportunity . This project 
was done in Joint School District #1, City of 
Rhinelander et al, Rhinelander Public Schools , 

328 East Frederick Street, Rhinelander, Wisconsin 
54501, .'Telephone (715) 362-3465. 

B. A federal grant (Title V, Part C, Public Law 89-10 
was given to the Rhinelander Public Schools from. 
HEW, Washington, D.C. through the Department of 
Public Instruction, Madison, Wisconsin 53702. 

C- This report covers the period from May 1, 1974, 

through July 15, 1975. The official grant period 
was- May 1, 1974, through April 3,0, 1975; however, 
the extensive nature of the project prolonged it 
until July. 

D. The project was submitted to the Department of 

Public Instruction, Madison, Wisconsin, on February 
22, 1974, by Cedric A.' Vig, District Administrator . 

[I. BRIEF HISTORY AND GENERAL PURPOSES OF THE PROJECT 

A. Legislation concerning Comprehensive Educational 
. Planning and Evaluation (Title V, Part C, Public 

Law 89-10) HEW, Washington, D.C. was the enabling 
legislation and source of funding for the project. 

B. District Administrator Cedric A. Vig was responsible 
for initiating the project as a result of a previous 
ESEA Title V Sec. 505, 1973-74. The various areas 
were represented by the implementers as listed below. 
Their responsibilities included determining data 
needed, sources (grades , persons) of data, instru- 
mentation, costs, dates for administration of in- 
struments, personnel to administer the instruments, 
scoring, and writing of sections relative to their 
specif ic . area . ] 

Outside Consultants for the project were retained- 

General Consultants - Dr. John vmooley 

c . UW-Eau Claire 
- Dr. Don Schmalzreid 
UW-Eau Claire 
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Dr. William Coulson 

UW-Superior 
Mr. Don Dailty 

UW-Superior 
Dr. David "Nuesse 
. UW-Eau Claire 

The purpose of this application was to request the 
funds of ESEA Title Part C to develop instrumen- 
tation and techniques to evaluate long and ishbrt 
range goals and- priorities of Joint School District 
#1, City of Rhinelander et al. These had been de- 
termined by a previous ESEA Title V, Sec. §05 pro- 
ject during the 1973-74 school year. 

After completion of the ESEA Title V project of 
1973-74^ it was obvious to the study committee that 
our most pressing needs in terms of equal educational 
opportu'nity lay in the K-6 schools . As a result the 
general focus of the pro je^::t developed around two 
goals: 

1. to provide all children in the K-6 
component of the school district 
with equal educational opportunities. 

2, development of a model for elementary 
school evaluation , 

The 11 elementary schools are beiefly described ^ 
below. 

Cass ian-Woodboro is a 4-room school of 6,576 
square feet, built in 1956 on a 10 acre site. 
The building houses approximately 100 students 
(K-6) and is designed to accomodate 135 stu- 
dents. It is located 12-13 miles west of 
Rhinelander on Highway K. 

Central is a 9-room school of 27,783 square 
feet, built in 1939 on a 9 acre site. The 
bui Iding houses approximately 200 students ' 
(K-^6) and is designed to accommodate 190 
students. It is located in the east-central 
part of the city. 

Crescent is an 8-room school of 10,000 square 
feet built in .1961 on a 10 acre site. It 
houses approximat'ji^' 167 children (1-6) and 
is designed to accommodate 205, It is located 
2 miles souffchwest of the city on Boyce Drive. 



Math 
Science 

Computer Analysis - 
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Curran is an 8-room school of 16,871 square feet 
built in 1933 on a 1.8 acre site. It houses 
approximately ',170 children (K-6) and is designed 
to hold 220 students. It is located in the 
southeast part of the city. 

McCord is a 9-room school of 18,-846 square feet 
built in 1900 on ^af 1. 3 acre site- It houses 
approximately 153 children (K-6 ) with a design 
capable of housing l90 children. It is located 
in the northwest part of the city . 

Newbold is a 7-room school of 17,782 square feet 
built in 1956 with an addition in 1967 on a 20 
acre site . The building houses approximately 
188 children (K-6) and is capable of accommodat- 
ing 220 s tudents . It is located 6 miles north- 
west of the city on Highway 47. 

Pelican consists of 2 structures, 12 rooms, of 
13 , 94 6 square feet built in^l951 with a 1956 
addition onja 9 acre site. It houses approxi- 
mately 292 students ' (1-5) and is capable of 
housing 330 students. It is located 2 miles 
' east of the city on Highway 8. 

Pine Lake i^ a 13-room school of 23 , 255 square 
feet, built -in stages 1952 , 1957 , 1963, and 1970 
on an 11 acre site. It houses approximately 
317 students (K-6) with a design capability of 
355 students. It is 2 miles north of the city 
on River Road. 

South Park is a 7-room school of 22,914 square 
feet built in 1952 on a 2 . 8 acre site. It 
houses approximately 185 children (K-6) with a 
prescribed , capacity for 190. It is in the south- 
west section of the city. 

Starks is a 2-room school of 3,115 square- feet 
built in 1954 on a 2 acre site. It houses ap- 
proximately 46 students (1-6) and. has a design 
capacity of 55 students. It is 9 miles east of 
the city on Highway C . 

* "West is a 10-room school of 24, 660 square feet 

built in 1923 with a 1939 addition on a .7 acre 
site. It has approximately 242 students (K-6) 
plus special education with a capacity of 250. 
It is located on the west side of the city. 



10 

-5- 



o 

ERIC 



III. SPECIFIC PURPOSES 



Consistent with the desire of providing equal educational 
opportunities for all students and using^ teacher and dis- 
trict goals from a previous Title V ^project, 2 broad goals 
were sought: 

1 . to determine if equal educational oppor- 
tunities exist for all K-6 children in 
the Rhinela-nder, Wisconsin, Public Schools, 
and 

2- to develop a model for evaluation 'for the 
K-6 schools. 

In the evaluation of the model the following objectives 
were formed: 

1. Define equality of educational opportun- 
ity. 

2. Specify and justify the criterion (a) to 
be used to determine if equality of edu- 
cational opportunity does exist . 

3 . Relative to the aforementioned definition 
and criterion (a) , prepare a data-gathering 
master plan that specifies needed data, data 
sources, instruments, and/or procedures in 
addition to describing the ' data-gathering 
tasks to be done in terms of re.sponsibility , 
resources, and time. - 

4. Specify data analysis procedures. 

5. Specify procedures to be.us^d to evaluate 
the project. " 

6. Devise a reporting procedure to conununicate 
the study to the public. 

7. Develop 'a research design format. 



Because" of limitations of time, money, and manpower, the 
decision wa's made not to check out all students on all 
goals. As a result, only grades 2, 4, and 6 were involved 
in the study, and the areas of math, reading, science, and 
self concept were considered. In all areas, grade 6 was 
included because this is the termination grade for ele- 
mentary schools, and it related to the purpose of deter- 
mining equality of educational opportunity. Finance was 
also selected for a detailed study to make some determina- 
tions about cost and to begin the gathering of data rela- 
tive to costs for future decisions about building, grade, 
and student costs. 

-6- 
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IV. DESCRIPTION OF THE PROJECT ' 

A. MATH • - . 

Grades 2 and 6 were selected because the math "text, 
series is split with Houghton-Mifflin K-"2 and Laid- 
law 3-6. The decision .wa^ made, therefore, to test 
grade 2, which is the end of the Houghton-Mifflin 
series and grade 6, which is the end of the Laidlaw 
series. Learner achievement with relation to in-u- 
structional objectives constituted needed data. 

A special ad hoc committee of teachers from grades 
2, 4, and 6 met with the person • responsible f or • 
implementation of the math , tes4:ing . A search of 
available test materials was made, and after several 
committee meetings and committee discussions with all 
teachers of grades 2, 4, and 6, the Wisconsin Mathe- 
matics Test was selected because it best met data 
requirements, reliability and validity, difficulty 
level, and discrimination index criteria. 



/ - 



The W-.3Gonsin Mathematics Tests (available from DPI) 
were used, and the scoring was done on the computer 
at University of Wisconsin-Eau Claire based on raw 
scores (RS) . The tests were administered b.y the 
classroom teachers to the entire class, and direc- 
tions were furnished with the tests. Testing was 
done during April of 1975, Scoring was done on a 
standard form for the computer at the UWEC. 

Both, grades requijred a minimum of two days for the 
testing. The grade 2 test was considered by many 
teachers to be too long for a single testing session 
for second graders. Grade 6 did not report this. 

It is recommended to have the materials in the teach- 
ers' hands well in advance of ttie testing for pre- 
viewing and inspection to insure-vthat shortcomings in 
materials can be remedied prior tO the start of test- 
ing sessions. \ 

All students in grades 2 and 6 were tested. Teachers 
served as test administrators with guidance in the 
form of written directives and materials from the 
Wisconsin Mathematics Tests (DPI) and the central 
office. 
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READING 



Grades 4 and 6 only were selected. A developmental 
reading program was given a high priority' in a sur- 
vey of needs by K-12 teachers in the spring pf 1974. 
To initiate this program a sequence of .reading skills 
was* dfetermined by K-6 teachers. Each grade is held 
responsible to teach specific skills. 

• * • 

Having previously identif ed reading objectives for . 
each grade level 1-6^ the test sampling was drawn 
from that list of objectives. 

Objectives from grades ly 2, and 3 were used for the 
fourth "grade test. The reading consultant matched 
district objectives with the list of objectives a- 
vaj.lable from the SRA Mastery 'Series SOBAR Reading. 
The district objectives which most clearly matched 
those of S'RA were selected- first. ^ Those less clear- 
ly matching were then selected un-til 40 matched ob- 
jectives were obtained. 

The same, procedure was followed for the sixth grade 
test^u^irng^-^salected primary (1, 2, 3) grade objec- 
tives and alloT^h-e— objectives from grade 4 and 5. 
Criterion-referenced tests wefH— deveJLo^ed^y SRA us- 
ing their Mastery Series SOBAR Reading base^r~on-%; 
district's selection from the list of objectives as 
described above. Three tesi^ questions were chosen 
by SRA to^evaluate the students ' knowledge of each 
obj ective selected . • 

The selection of reading objectives, criterion- 
referenced ^ tests , and related preparation took place 
over the. winter of 1974-75. . • • 

On April 21 the fourth and s.ixth grade teachers par- 
ticipated in an inservice with all testing proceeding 
that week and completed by Friday, ApriX 25. The 
test scores- arrived during the first week in May and 
were given to our consultants for -further analysis. 

Scoring was done in 2 ways. Mastery of an objective 
to meet SRA standards meant that a student got 3 .of 3 
items correct for each objective. To meet mastery 
standards at the district level it was decided that 
2 of 3 items correct on each objective was sufficient 
This is' jShown on the. reading table page 18 as M-SRA 
Mastery and L-Local (district) mastery. 

There are 2 limitations that entered into decisions 
, about the testing. First, cost limitations were a 
factor in testing only grades 4 and 6. Second, the 
list of objectives available from SRA for matching 
with district objectives was limited. 
-8- . 



SELF CONCERT 



The committee recommended that all children in 
grades^ 4 and 6 be tested using a group administered 
test. ' The goals iden'tified by the district 'staff , 
in the work 'referred to earlier, placed self con- 
cept as the first priority. For this reason it was 
included in the study. 

The ad hoc -committee of 8 teachers and 1 adminis- 
trator investigated the instruments available on 
the mark*et. Instruments available were best suited 
for grade 4 and higher. Problems of instrument 
validity, reliability, and emphasis (personality 
traits) were recognized. - 

.The ^>^tERS- HARRIS CHILDREN'S SELF CONCEPT SCALE was 
rep^mmended by the ad hoc committee as the best 
s^tiited. instrument to meet project needs. The teach- 
/ing staff administered the scale after receiving 
written administration directions. The children . 
received test booklets "and wrote on an^swer sheets 
developed by the . committee with perijiissidn from the 
publisher. The same booklets were used by both 
grades. * A proctor was present in the classroom to 
aid the teacher in administering the, scale. 

A person was hire^ to determine the raw score^^qr 
.each chil(^^ A^_probXem,,-enoo con- 
cept project was in the area of s^^udent identifica- 
tion. By design- the only information gathered at. - 
the time of -test administration was the sex,' grade, 
and school of the child. If this type of testin'g iS 
done in thfe future, chi^ldren will be identified by 
student number. The data that was collected was use 
as bafeeline data to develop district norms by sex. 
The teaching staff and students of grades 4 and 6 
were used in the project. . 

•SCIENCE (AAAS) 

Grades- ? ,i 4, and- 6 were selected for testing in 'this 
area. AAAS was chosen because it is^a system-wide 
program,, the curriculum is defined for each grade 
level, it' has a process method of^ teaching, and the 
system had been using it for a number of years. 
Tests were based pn instructional objectives for 
ea,ch grade leveiyfrom the science curriculum guide. 

With gui-dance from the scienc? consultant from UW- 
Superior, the science testing program was developed 
relatively- independent of actual teacher input from 
any ad hoc committee. 

-9- 
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' Grades 2 and 4 were tested *1 week and grade 6 the *- 
follo\;;7ihg week. Th^ time devoted to each part of 
the test depended on objectives being tested- The 
test for each objective was taken by at least 2 
children- Most tests were approx^imately 10-15 min- 
utes in length- In sixth grade, tests were approx- 
imately 20-30 minutes- Kits containing the neces- 
s'ary materials were furnished by UW-Superior, and 
both manipulative and written tests were used- 
Tests were administered on a one-to-one basis in 
grades 2' and 4 with examiners reading questions and 
, students using ''manipulative materials- The grade 6 
test* was in written form, and reading assistance 
was given when necessary- UW-Superior scored the 
tests, and data received was raw score - 

"All students in grades 2, 4, and 6 were tested- 
Examiners were Mr- Don Dailey, instructors, and 
graduate students from UW-Superior- UW-Superior 
^ personnel were selected to do testing because of 
the University * s long association with and known 
expertise in-AAAS- • ., 

E- FINANCE 

o A study was made of each school's costs for the 

19 74-7 5 school year- These dat^ were^ ddve'ldped on 
• per building and per pupil costs based on the follow- 

i-n^^-Gategi:irie^_v__^^ textbooks, audio-visual, 

^'library books, library "perxodrieai^-, — ijiatructional 
equipment, physical education supplies, maintencance^, 
school secretary, classroom aides and 'miscellaneous 
play equipment, janitors, teachers, and principals. 
An operational cost analysis for a single year was 
done to determine how much was spent per pupil in 
the categories in each of the eleven elementary 
schobls- See Appendix C- 

The persons responsible for handling the financial 
portion of the study, th®^ district bookkeeper and 
her aide, and a person wnb was hired part time for 
this specific purpose implN^mented this part of the 
study - 

The finance co-chairpersons developed a form speci- 
fying the various categories of data needed by school 
Ideally, the cost analysis study should have gone 
back 2 or 3 years, but because of time and funding 
constraints it was not feasible. for this study- It 
will continue into the future. There was no student 
or teacher involvement in this part of the study. 
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F. TEACHER INPUT 



Teachers were asked to indicate their education, 
majors/minors, and subjects preferred b'y rank order- 
Teachers • were also asked to rank order areas '^they 
preferred to teach in and list the number of min-- 
utes they spent on each area and rank order them. 

All of the elementary teachers were required to do 
this on the form which is shown in Appendix D. 
If data was missing the teachers were contacted per- 
sonally to^ insure that every section was completed . 

Because of limitations of time, money, and research 
design , this data has not presently been analyzed . 
It is felt , howeve^r , that thife data will be of value 
in examining and providing for quality of instruc- 
tion in the Rhinelander , Wisconsin , Public Schools . 



EVALUATION METHODOLOGY 

The evaluation methodology described below is separated 
on ,the basis of Goals 1 and 2 respectively . 

Section 1. details the evaluation methodology employed • 
in the study relative to goal number 1. The information 
collected, the analysis procedures employed, and the re- 
sponsible pe^rsonnel are detailed under the categories of 
math, reading, self concept,, science, and population de- 
scriptors. Data collecting procedures and responsible 
~^er^enriiei__are_al so listed for finance and teacher input . 
Analysis procedure^^lftTexe-no^t^-i^mpip^^ for the latter 
categories- — 

Section 2. describe^ the summative procedures used to 
evaluate the project.. 

A. MATH 

The Wisconsin Mathematics Test developed-by the 
Department of Public Instruction was used to eval- 
uate this ai^ea. On April 15 and 16, 197''5, the 
formal testihg was administered by the classroom 
teachers throughout the district for grades 2 and 
6. Raw score data was collected. / 

Students of grade 2 (N==267) and grade 6 (N=311) 
were tested across all' schools . An Analysis of 
Covariance with multiple covariates wds used. The 
' independent variables IQ, Sex, and Sopial Economics 
Status (SES) were statistically removed from the 
data. The null hypotheses of no difference between - 

■ -11- 
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schools by grade was tested with reference to the 
dependent variable, math achievement. The F ratio 
was used to statistically measure for any overall, 
differences between groups at the -05 level. The 
Duncan' test was used for pairwise comparisons in 
grade 2, but the Newman Kuels test was used in 
grade 6. 

B. READING 

Reading was evaluated at the fourth and sixth grade 
level' with the custom designed SRA-SOBAR reading 
criterion referenced test. The test items were 
based on instructional objectives . The classroom 
teachers administered the test in a formal setting 
on April 22 and 23 , 19 75 . The data collected were 
raw scores'with 3/3 correct meaning Mastery of the. 
instructional objective. by SKA standards and 2/3 
correct for Local mastery. 

The testing wap done across schools with fourth 
grade (N=274) and sixth grade (N==311) . An Analysis 
of Coyariance with multiple covariates was used. 
Sex, IQ, and SES were statistically removed from 
the data. The null hypotheses of no difference be- 
tween schools by grade was tested with reference 
to the dependent variable, reading achievement. The 
F ratio was used to measure any overall differences 
at the .05 level. The Newman-Kuels was used at both 
grade levels for pairwise comparison.. 

C. SELF CONCEPT 

The Piers-Harris Children's Self Concept Scale was 
used in a group setting to gather data on the dis- 
trict's goal, self concept. Teachers administered 

— — ^-tiie scale in a formal group setting on April 7 and 
8, T975 7^~r-D^ta~~i:iQjJ^ected were raw scores by sex, 

' grade , and bui Iding r~~~^^^^~~~^-~— — — — — _ \ 

The testing was done across schools for\fourth gFaTde^ 
{N=261) and sixth grade (N=311) . Data in this area 
were gathered and recorded only in terms of the sex 
of the child, grade, and the school attended. The 
null hypotheses of no difference between schools by 
grade was tested with reference to the dependent 
variable, self concept. An Analysis of Covariance 
with multiple covariance was used; with sex and IQ 
statistically removed from the data. 

The F ratio was used to^ measure any overall differ- 
ences at the .05 level. The Newman-Kuels paii^wise 
comparison test was used for both fourth and sixth 
grade data. 

-12- 
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D. SCIENCE 



A learner achievement test based on instructional 
objectives from AAAS Science was used to gather, 
data on April 28 and 29 and May 5 and 9, 1975. 
The test was developed from randomly selected ob- 
jectives from the second, fourth, and sixth grade 
AAAS Science curriculum. Raw score data were 
collected. 

The testing was done across schools for second 
(N=:=251), fourth (N= 251), and sixth (N=289). The 
null hypotheses of no difference between schools 
by grade was tested with reference. to the depen- 
dent variable, science achievement. An Analysis 
of Covariance with multiple covariates was used 
\ with Sex, 10 and SES statistically removed from 

the data. The F ratio was used to measure any 
overall differences at the .0^5 level. The Newman- 
Kuels pairwise comparison tes't was used for second 
; and sixth grades data. In fourth grade science the 

Duncan test wjfs used in place of the Newman-Kuels 
method. 

E. FINANCE 

/ 

A locally developed format was used to. gather data 
for the cost analysis. This activitv was completed 
during April and May of 1975. Data were gathered 
and presented as cost per building and cost per 
pupil for the 1974-75 school year only. The data 
were gathered bv an individual hireti specifically 
H to locate this information. 

Data were gathered for all 11 elementary schools 
in all the areas where information was available. 
The exceptions were in audio-visual (1) , school 
maintenance (2) , school and district paid classroom 
aides (7), and schools where the' operational pat- 
terns differ such as 2 IGE schools. Although the 
data 'was gathered no tests of significance were run 
because of time and money limita^tions and to the 
limited data gathering--one year. 



F. TEACHER INPUT^^ 




A locally developed format was used to gather~^~~~^~^- 
'teacher input. This activity was completed during 
May, 1974. Data was gathered by reguiring each 
teacher to fill out the form^ completely . There 
wore no exceptions to the data collecting effort. 
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No tests of significance were run on this data 
because of time and money limitations. Future 
evaluation and planning will likely. use this, 
information* 



SECTION 1. 



SUMMARY TABLE 



Area 


Instrument 


Gr 


, and N 


Stat. Test 


S xgn . 
Level 


A— IVlAin 


Test 


n_ 

4 

o — 


^ IN — ^ D / } 
^ N— ^ 1 i } 




• \ ■'■ 

N 

E ra t jlo , 

uuricari 

F ratio , 

IN e wiuan ~ i\u^ 4- s 


OR 
OR 

\ 


- 

B-READING 


SRA-Mastery 
Series SOBAR 
Readinq 


„ 

4- 

6- 


(N^274)- 
(N=311) 


F ratio, 
Newman- Kuels 
F ratio, 
Newman-Kuels 


.05 
\Q5 


C-SELF 
CONCEPT 


PIKRS-HARRIS 
Children' ^ 
Self Concept 
Scale 


4-^ 
6- 


(N=261) 
(N=311) 


F ratio, 
Newman-Kuels 
F ratio, 
Newman-Kuels 


.05 


D-SCIENCE 


UW-Superior 


2- 


(N=251) 


F ratio. 


.05' 




AAAS-Science 






Newman-Kuels 






Rhinelander 


4-- 


(N=251) 


F ratio. 


.05 




Project 






Duncan 








6- 


(N=289) 


F ratio.. 


.05 






^ 




Newman-Kuels 





\ ■ ^ G - 



\ 
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SECTION 2. 



This section describes the summative activities and 
procedures used to evaluate the project-. The model 
for elementary school evaluation was generated in 4 
stages and in such a way that it could evaluate all 
4 stages of the model. The evaluation plan will give 
the reader an idea of the kinds of changes which were 
generated by the internal evaluation. 

Internal evaluation was aidedfby the development and 
use of the format below that included a brief defini- 
tion of the stage, a decision to retain or change a 
decision made by the group, suggestions for change, 
and unusual action. Each researcher went over the 
evaluating plan independently of the others, and then 
a consensus session was conducted. 

EVALUATING PLAN 



The purpose of this instrument is to-determine your 
perception of the merit/worth of the .d^ecisions made 
in the defining, planning, implementing and evaluating 
stages- . 

The X*s in the Retain column indicate that the internal 
eval,uators saw no need to change this portion. 







Indicate by 










(+) whether 


I f change 








you would 


indicated 


Unusual 






change/retain 


a. Why 


Action/ 






a decis 


ion 


b. What change 


Proced- 






Retain 


Change 


iS' suggested 


ures 


Stage 


1 - DEFINING 










A. 


Problem 


X 








B. 


Sub-Problems 

(1) 
(2) 
(3) 

(4) 


X 








c. 


Definition 
of Terms 
(1) 
(2) 


X 




. ' 'p- ■ 






Roles and 
Functions 
(1) 


\ X 










721-; ^ 
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Indicate by 










(+) whether 


If' change 








you would 


indicated 


Unusual 






change/retain 


a. Why 


Action/ 






a decision 


b. What change 


Proced- 






Retain 


Change 


is suggested 


ures . 


E. 


Context 

Description 

(1) 

(2) 

(3) 

(4) 

(5) 


X 




— 




Stage 


2 - PLANNING 










A. 


Purpose 


X 








. B. 


Goal 


X 








C. 


Objectives 

(2) 
(3) 
(4) 
(5) 


X 


• 






D. 


Regarding ^ 
Obj . d 
(1) 
(2) 


X 




- 




E. 


Regarding 
Obj. b 
(1) 
(2) 

(a) 
(b) 

(3) 


V. X 

V 




■ 




F. 


Regarding 
Obj . c 


X 


■ 






G. 


Regarding 
Obj^ d 


X 








H. 


Regarding i 
Obj . e 
(1) 

(a) 
(b) 










I.. 


Regarding 
Obj . f 
(1) 
(2) 
(3) 










J. 


Regarding 
Obj. g . 











Stago 3 - 

IMPI.E MENTATION 
A. Areas (Math, 
Reading, 
Science, etc) 



(1) 


Instru- 




ments 


(2) 


Implcmen- 




tor 


(3) 


Cost 


(4) 


Adminis- 




tration 




Dates \ 


(5) 


Test 




Adminis- 




trators 


(6) 


Scoring 


(7) 


Data 



Stage 4 - 

EVALUATING 

A. - Evaluation 

(1) Internal 

(2) External 
(DPI) 

(3) Decision- 
Making 

B. Process 

(1) How? 

(2) By? 

(3) For? 



Indicate by 
(+) whether 
you would 
change/retain 
a decisisOn 



Retain Change 



Math X 



i Sc i once 

I X 



If change 
indicated 

a . Why 

b. What change 
is suggested 



Math X Sample math 

obj/more items 
per obj . 2/3 
for local 
mastery 



Test earlier/ 

test sessions 

too long 

Train locals 
(tchr. ,cxides, 
vol . . to test) 

6th gr. test 
(1 to 1) same 

as gr. 2 & 4 



jX.all * .Present data 

I in better form 
Self j 
Conc6?pt 

X Gather data for 
each individual 



Internal evaluation was to be done by the primary . 
consultants and district employees who were instru- 
mental in the development of the project* They each 
received blank copies of the evaluation form and com- 
pleted it i<n isolation- 
Then these evaluators met as a single unit and re- 
fined the evaluation data into a single report whi""' 
is indicated herein- 

External evaluation will come from the DPI in Madison. 
That office will apply the criteria as defined in the 
VC application with regar^ to the study as presented 
here and whether or not the grant recipients have in 
•fact met the criteria* 

Decision-making is at the heart of the evaluation 
plan. It is with regard to the use of the data gath- 
ered, computed, analyzed; and reported that decisions . 
regarding next step(s) will be made. 



VI. BUDGET 

County and District Number: , 43-4781 
Joint District #1, City of 
Rhinelander et al 

Report for period ending 3 0 June 197 5 . 
Title VC 

Approved Budget $9 00 0.00 

Amount of Grant 
Encumbered Total 
Balance 

Balance from LVEC Fund + 1,54 4.8 6 

Pinal Balance ^ .00 



VII. RESULTS 

Table and Figures 

Section 1. 



$ 9,000.00 
10, 544.86 
- 1,544.86 
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A. MATH TABLE 



Schools 




e.g. At second grade leve/l school G's math achievement is 

significantly highe;r" than' schools A, B, E, H, I, and K. 



25 cells of a possible 220 cells show statistical significance 
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M = SRA Mastery 3/3 
L = Local Mastery 2/3 

e.g. At fourth grade level school E's reading achievement is 
significantly higher than school D in both. SRA and Local 
Mastery at the fourth grade level. 



5 cells of a possible 440 cells show statistical significance 



or 
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C. SELF CONCEPT TABLE 



Schools 









B 


c 


b 


E 


F 


G 


H 


I 


J 


K 


A 
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\\^\> 




•k 
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a 

D 






















C 








WW 
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/I 






















f; 
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E 












WW 
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5 






* 
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b 






















G 
















\V\Vs 

\\\\S 










A 

fi 






















b 






















H 


















VvVv 








/I 






















6 








— 














1 


























4 
























6 






* 
















J • 














— f — 












4 






















6 . 






















K 
























m 


4 






















6 























* = Indicates statistical significance at the .05 level. 

e.g. At sixth grade level school A's self concept is signifi- 
cantly higher than school C. 

3 cells of a pTossible 220 cells show statistical significance. 




* = Indicates statistical significance at the ,05 level, 

e.g.. At fourth grade level schools A, B, C, ^nd H's science 

achievement are significantly higher than.^ schools J and K. 

8 cells out of a possible 330 cells show statistical significance 



"REVIEW OP THE TABLES 



A. MATH 

Differences at the second grade level were signifi- 
cant, in the' following cells. School F and School A; 
School G and Schools A, B', H, I, and K. 

Differences at the sixth grade level were signifi- 
cant in the fallowing cells. Schools E and School 
D; School F and School D; School J and all other 
element-ary schools'; School K and Schools A^ B, 
D, H, and I . * • 

B. READING ' ' . 

Differences a't, the fourth' grade level were . signifi- 
cant in the following cells . School A and School D 
on SRA and Local Mastery; School E and School D on 
SRA and Local- Mastery ; School I and School D on 
' Local ' Mastery anly . 

C. SELF CONCEPT 

Differences at the sixth grade level were signifi-- . 
cant' in the following cells. School A and School C; 
School E and School- C; School I and School C- 

D. SCIENCE (AAAS) ^ 
*• ' ^ 

Differences at the fourth grade level were signifi- 
cant in the following cells. School A and Schools J 
and K; School B and Schools J and K; School D and 
Schools J and K; Sbhool H and School J and K. 

In the total analysis of the 4 areas 41. cells of 1210 
cells. show statistically significant differences. 

Using learner achievements as the essential criterion of 
equality of educational opportunity/ the data supports 
the position that equal- educational opportunity does in 
fact exist in the Rhinelander Public Schools. 
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Vlil. DISCUSSION 

Early in the pro j ect the decision was made to deter- 
mine whether equality of educational opportunity ex- 
ists in the ^Rhinelander Public Schools. Learner 
achievement was accepted as the best indicator of 
equality of educational opportunity, and such achieve- 
ment should be examined in relation to the district ' s 
goals for elementary education. 'As a result achieve- 
ment in the math, reading, and science areas and self 
concept were chosen as the dependent variables. , 

If the decision had been made to search for sameness 
in the elementary .schools , the entire projects would 
have been changed. • The areas under investigation for 
sameness would have, cei^tered on site and plant, staff, 
materials, programs ,v pjAPil services, and budget. 

From a philosophical point of view it seemed reason- 
able that educational decisions should be made on the 
basis of data collected and analyzed via a well-conceived 
evaluation model inclusive of a good research design. 
From an administrative point of view this allows deci- 
sions based on data, not hunches. 

The project led the district into considerations such 
as quality of instruction, inservice programs, school 
operations, and building uniformity for further inves- 
tigation. The capability exists with th,e present data 
to develop new and additional projects as the district 
sees the need(s) . Having carded all data for each child 
in each area, if it is decided to request new or addi- 
tional data, it is only necessary to send' the cards and 
new data to UW-Eau Claire, and in a few days the request- 
ed information is back. 

I- 

With significant differences in only^-41 cells of 1210 
cells. there is support for the' position that equal edu- 
cational opportunity does ejeist. however, limited sam- 
pling on limited goals in a limited time does not pro- 
vide any conclusive evidence'. The gathering of data 
must.be done over time. 



IX- SUMMARY 

Based on the notion that equality of educational oppor- 
tunity is best determined by learner achievement of de- 
sired instructional goals/objectives, the very limited 
'data collected in the study support the' position that 
such equality does exist for students in grades K-S in 
the Rhinelander , Wiscons-in , school district . 




Constraints on the project in terms of time, money., 
and personnel, and feasibility in school programming 
resulted in a limited sampling of the goals deter- 
mined important by the district's teachers; namely^ 
self concept and basic skills, the latter restricted 
to math, reading, and science for students in selected ' 
grades. Attention was given to selection of valid 
data-gathering devices, and thus ev^ry effort was. made 
to assure content validity in the subject-maitter tests. 

Selection of the inatrume*i-it to measure self concept was 
confounded by the problems of validity and reliability 
of such insferyjfrtints and the absence of well-defined cur- 
ricular objectives related to the goal. Por those rea- 
sons, the data collected were not coded individually ^ 
were treated essentially a^s base ' line information , and 
were analyzed only on the basis of sex and grade group. 
The committee charged with the' selection of the instru- 
ment concerned itself with validity and reliability, 
and after much searching selected the test that appeared 
to be best for the situation. 

Given the limited sampling described above, the most 
significant weakness in the project was the failure 
to" write a research proposal that addressed itself to 
the specifics of data gathering. This problem is dealt 
with in the recommendations given below ^ ^ 

Vlhen the decision was made to check on equality of edu- 
cational opportunity , essentially in terms of learner 
achievement of objectives/goals, the problem of bias 
in. goal selection surfaced. ' The committee recognized 
the problem and selected the sampling areas in terms 
of perceived importance, feasibility, and constraints 
as indicated above. It is recognized that before a for- 
mal, definitive statement can be made about the equality 
of educational opportunity, there will have to be much 
data analysis across a more e-5j:tensive sampling of the 
district ' s goals/* ^ 
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RECQMMENDAT I ONS 



Analyze teacher input base for such'as inservice 
and staff deployment. 

Completely develop a code for the contents of com- 
puter data cards. 

Data card system be used as storage for future 
studies - 

Data on self concept be coded by individual, on 
the assumptions o£ defined curriculum and valid 
instrumentation- . " 

More time given to instrumentation — development 
, or selection. 

Greater emphasis on criterion-referenced instru- 
mentation. 

Use^ of data as a basis for investigation of such 
as the following: quality of instruction, in- 
service programs, cost control, building design, 
staff deployment. 

Replicate the study in 1975-76? 

Extend the study to other -goals and students . 

Staff inservice relative to evaluation . techniques ^ 

Maximum involvement of instructional staff in 
evaluation program^ to enhance program offerings. 

Yearly cost analysis to provide per pupi\ cost 
by. school across districts. • 

Use by teacher of data collected from his (her) 
classroom to modify instruction. 

Sample math objectives and have several items 
per objective, rather than one item for all (each) 
objectives . 

Respect other obligations of teachers^, students, 
and administrators , when conducting an evaluation 
study. 
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CRITERIA RELATED TO ELEMENTARY SCHOOLS 

^ ^--^'^ ' " ^ ■ ' . 

(Progrann Goals ) 

** ». 

THESE ARE THE 5 GOALS THAT HAVE BEEN SELECTED BY THE K-6 
TEACHERS AS RECEIVING TOP PRIORITY IN THEIR WORK. 

1. Self Concept 

To develop a positive self concept and 
appreciation of one's worthiness as a 
member of society, 

2 . Basic Skills " . 

To attain knowledge anc^ experience in 
the areas of natural sciences, social 
sciences , humanities , and , the arts , - 

3. Skills To Use Knowledge 

To develop the perceptive skills for 
.creative , constructive , and critical 
thinking, problem solving, and evaluation. 

4. Human Relationships " - 

To recognize the worth of every person 
and to develop skills in personal-social 
ad j ustment and human relationships . 

5. Health 

To develop good health habits and an ' 
understanding of the conditions necessary 
for maintaining physical and emotional 
well being. 




Appendix B 



ELEMENTARY SCHOOL EVALUATION MODEL 



OVERVIEW 



There are four stages in this model- Each stage is charac- 
terized by a goal(s) with associated tasks and decision-making, 
Summarily: 



1) 



Stages 
DEFINING 



2) PLANNING 



3) IMPLEMENTING 



4) EVALUATING 



Goals 

1) Clear statements of the problem, 
sub-problem, terms , roles , and 
context - ^ 

2a) Statements of project purposes, 
goals , and objectives. 

2b) Statement of means to the achieve- 
ment of ends . 

2c ) Statement of procedures to evalu- 
ate the project - 

3) Carrying out of planning- This 
involves both maintenance and 
modification of planning decisions 
related to 2b and 2c above. 

4a) A determination of'the merit and/or 
worth of. defining, planning, and 
implementing decisions- 

4b) The processing of data for decision- 
making regarding the next step. 
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Appendix C 



FINANCE 
1974-75 



TT* V o T "Hnvo 
JD 1 X U. L. Ll X c: 


Cassian 
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Crescent 
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tn 
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X ■ XT i X IXV_» X |Jcl X o 
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19. Electricity 
























20. Telephone 
























21. Travel 
























22. Snow Plow 
























Repair 

23 . Building 
























24 . Site : 
























25 - Equipment 
























26- Food Service 
























27. Capital Oilt lay 
Equipment 
























Total Cost 
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Average Membership 
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Appendix D 



TEACHER INPU"] 



!• DEGREES B.S, M.S. 



(school) ( school y 
Major (s) \_ Minor (s) ^ 



2. Rank order the subjects 1 to- 5 as you prefeiT to teach 
them (1 being the most preferred, 5 being the lea^t 
preferred) . 

•? 

Arithmetic 
Reading . 
Science 

Social St. 

English _____ 
Spelling 



3, In what area(s) do you feel .best prepared to teach? 



How many credits do you have in this area? 



4, In what area(s) do you feel least prepared to teach? 



How many credits do you have in this area? 



Rank order the special areas as you prefer to teach th^rn 
1-3. 

Art ' ____ 

Music ^ • 

Phy Ed J . ' 



6. Rank order the grades as you prefer to teach them l--?, 

1 being most preferred, 7 being least preferred. 

Grade K 
1 

2 ' " 

3 izzz 

- 4 ; 

■ 5 

6 



Name 
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